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ABSTRACT 

Reported is a study to determine the effect of 
planetarium instruction in terms of immediate attainment, attitude, 
and retention in the teachir;g of selected celestial motion and 
non-celestial motion concepts, when contrasted to or combined with 
the inquiry activities utilized by the nationally developed science 
curricula. Observations were made on three treatment groups at both 
the junior high school and college levels. One hundred eighth-grade 
students in a school systeip in New York participated in the study 
which was replicated at Edinboro State College, Pennsylvania. 
Investigator-developed instruments were administered six weeks after 
the treatment to measure retention. An astronomy related semantic 
differential instrument was designed to measure student perceptions 
concerning the unit of instruction and astronomy in society. Results 
indicated that: (1) the group (Treatment Group I) which experienced 
the orientation session did significantly better on content learning 
than the group which did not; (2) the combined treatment group (III) 
was the only group which significantly benefited from the treatment; 
(3) all groups showed minimal loss of content achievement on the 
retention test; (4) no interaction effect between treatment and 
retention was noticed on posttest data for the college treatment 
groups; and (5) the planetarium group (I) in both junior high and 
college studies had the greatest positive perception change. 
(Author/PEB) 
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Claims of the Planetariun^ s Eff ect iven ess 

Numerous articles have been v;ritten which indicate that the planetarium 

is a supurb tool for instruction and that it imparts an excellent understandin 

of the conceptual basis of astronomy. Horris and Peterson (1972), writing 

about how the planetarium can best be brought to the students, state: 

*' . . . .planetariums take science out of the realm of 
the abstract, bringing it clearly and enjoyably to 
life. x\stronomy and space science become relevant 
especially v/ith the planetarium's ability to simu- 
late n;ost celestial phenomena .... the planetarium 
is a powerful motivator.'* 

Steiitl auni (1968), referring to the importance of the teachers chosen 

to direct the planetarium, states; 

'\ . . . tiie skillfully used planetarium is a supurb 
tool for teaching. It can impart t. he learner, 
\;hether child or adult , r.ii excellenL idea of the 
conceptual basis of astrnnomy." 

Statements such as the above are typical of the claims that educators 

have made regarding the planetarium facility. These statements, however, 

are based upon intuitive feelings and not on research findings. The bulk 

of the planetarium research deals with the managerial aspects of running 

such a facility. 

Research studies have been conducted whicii attempt to evaluate the 
effectiveness of the planetarium as an instructional device. In general, 
these studies conclude that the planetarium is less effective than classroom 
instruction in the teaching of specific astronomy concepts. All the major 
research studies brought the students into the planetarium and taught them 
specific content objectives. This planetarium group was then compared to a 
classroom group taught the same content objectives. At no time was an 
orientation to the functions of the planetarium facility given to the group 
instructed in the planetarium. Planetarium operators have indicated the 
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necessity of an orientation session or sessions before a meaningful lesson 
can be taught. One must overcome any ''mystique effect" which may be present 
before instruction can be successful. 

Previous studies have failed to provide controls for teacher effective- 
ness as a variable in one teaching situation, the classroom, over another, 
the planetarium, Campbell (1963) indicated that the consistency of instruc- 
tional quality in any comparative treatment is a variable which must be 
controlled when attempting to determine the influence of various means of 
instruction. (See Tables 1-3). 

Formal Statement of the Pro blem 

The purpose of the study ir> to det,i2rmine the effect of the planetarium 
in terms of iiu'^ediate attainment, attitude and retention in the teaching of 
selected celestial motion and non-celestial motion concepts, v;hen contrasted 
to or combined with, the inquiry activities utilized by the nationally developed 
science curriculuius . 

Significance of the Study 

iioore (1966) indicated that the planetarium facility is the most complex 
visual ins tructional device that the teacher can employ. However, research 
into the effectiveness of the planetarium has been surprisingly meager and the 
few studies which have Deen conducted generally indicated that the planetarium 
is not significantly more successful in the teaching of selected concepts 
than classroom methods. If these research findings are accurate, then it would 
appear that the installation and operation of over one thousand facilities in 
the United States has been a mistake. These research findings question the 
credi^.abili ty of what educacors have professed about the planetariums . Further, 
if the most advanced audio-visual device in today *s schools is ineffective 
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as a means of instruction, this should be considered in planning for further 
technological advances. 

The Pilot Study 

The planetarium mystique effect, if existent, v/ould be an important variable 
to consider when res:\^arching planetarium instructional effectiveness, A pilot 
study was conducted early in the research to establish the existence of a 
irystique effect and to determine if an orientation session prior to instruction 
is effective in rainimizing this effect. 

Two comparable groups of students were administered the Daily Motion 
Concept Test C Poras vA&B ) a pretest to measure entering knowledge of the 
content objectives. One group was given on orientation session intended to 
familiarize students with the constructioa and operation of a planetarium. 
During this session three aspects of tue facility were discussed; the purpose 
of the dome ceiling, the function of the major components of the projection 
equipraenc and the purpose of the red lighting system. These were the only 
areas discussed during this session. The following day both groups received 
a planetarium experience dealing with diurnal motion. Tape recordings were 
employed with the researcner operating the projection devices. The Daily 
I-Ioticn Concept Test was again administered and changes in content achievement 
scores were analyzed to determine the relative effectiveness of the orienta- 
tion session on content achievement. 

Experi m ental Design 

Is the planetarium an effective instructional device for teaching selected 
astronomy concepts when contrasted to or combined with inquiry activities used 
in the nationally developed r^cience curriculums? In order to examine this 
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question a pretest-posttes t nieasure with three groups is desirable. The 

design used in this study is the Combined ^-lultiple Time-Series, Pretes t-Pos ttes t 

Three Group Design as described by Stanley and Campbell, 

Experimental Pr oce dure 

Observations ueve made on three treatment groups at both the junior high 
school and college levels. Treatment Group I received the planetarium instruc- 
tion consisting of one orientation session > three ses;3ions dealing with concepts 
of celestial motion and two sessions dealing with concepts of non-celestial 
motion, i.e., time zones and the earth coordinate system. Group II" received 
five sessions of instruction dealing with the same concepts as in Group I but 
through activity inquiries drawn from nationally prominent curriculum projects, 
Grov'p III experienced combined sessions of Groups I and II with concepts 
randomly assigned to the planetarium or classroom inquiry activities. Group 
III was established to determine if dimensions of retention, attitude and 
content achievement exist that can be reinforced by either treatments I and II, 

Popul ation 

The study was conducted using half the eighth grade students (W=100) 
from the Pine Grove Middle School o.^ the East Syracuse-Minoa School System. 
Students at this school are randomly assigned to one of two teams, then 
randomly assigned to classes. 

The study was replicated at the Edinboro State College of Pennsylvania 
during the first two weeks of the fall seraester. The purpose of the Edinboro 
study was to determine differences that may exist in content achievement^ 
retention and perceptions at various educational levels. 

ERIC 
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Orientation Session Results ; 

Table 4 showb pre and pocttest data for the treatment groups adminis- 
tered the Daily hotion Concept T est. Used as a pretest and a posttest this 
test was used to determine coD^2nt knowledge of daily motion. Treatment I 
(the control group) nad the instructional session in the planetarium. 
Treatment II tiad an orientation session prior to the instructional session. 

Table 5 shov/s the computed values of t obs. and the f approximation 
for the pretest data. 

TaDle 6 shows the computed values of t obs. and the f approximation 
for the posttest data. 

C ontent Knov/leage Pretest R esults : 

Table 7 summarizes r.he results of the pretest scores for both the 
college and junior high school treatment groups. An analysis of variance was 
performed on both the college and junior high school test results to test the 
hypothesis of no significant differences in entering knowledge. The analysis 
of variance for the junior high school treatment groups is summarized in 
Table 8 . As a preliminary test for homogeneity of variance an F max. 
statistic was determined. 

The analysis of variance for the college treatment groups is summarized 
in Table 9 

Posttest Results ; 

Table 10 summarizes the results of the posttest scores for the junior 
high scnool treatment groups. 

An analysis of covariance was performed on the posttest scores using 
the pretest as a covariate. 
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Table 11 shows the analysis summary table for the junior liigh school 
posttest scores. The adjusted means for thci treatment groups are also shown 
in this table. 

Table 12 suov/s the ajialysis of covariance summary table for the junior 
high school retention test scores. The adjusted means for the treatment groups 
are also sho\m in this table. 

Table 13 summarizes the results of the posttest results for the college 
treatment groups. 

As the analysis of pretest results indicated no significant differences 
between treatment groups, a 2 x 3 factorial experiment was performed in order 
to permit the evaluation of a possible interaction effect of treatments and 
posttests. The levels of factoi A represented the two posttest measures and 
the levels of factor B represented the three treatment groups. 

Table 14 summarizes the two-way analysis of variance. The data support 
the null hypothes:is that the main effects of factor B are zero. Inspection of 
the profiles in Fig. 1 of the simple effects of factor B for levels a^^ and a^ 
indicate the lack of interaction. 

The college posttest and retention scores were factored into their 
component concepts to determine if celestial motion concepts were better 
taught by one treatment than non-motion concepts. None of the observed F 
ratios were signific/uit at the .05 level. Inspection cf the simple effect 
profiles in Fig. 2 indicates the difference in growth of the combined treatment 
group. 

Analysis of the Astronom y Perception Test Scores ; 

Table 15 summarizes the pre-post results of the factor analyses of the 
semantic differential data for each of the five concepts in the Junior High School 
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and College studies. 

Figs. 3 & 4 illustrate treatment changes from pretest to posttest. 

Adjusted factor score (standard scores) changes are sho\m for the combined 
five concepts. 
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TABLE 4 

Pre and Posttest Group Data 
I " ■ — . - — — . . — ■ — 

j Sample Size f N= 26 \ 20 ' 

: ! ? ■ 

I Sample Mean x= 5.27 ' x= 4.65 ; Pretest 

i : i i i 

j Sample Variance i S= 2.66 j S= 2,13 

I I . 1 

! Sample Size \ N= 26 ; N= 20 

• Sample Mean * x= 7 . 88 ^ x= 9.25 . Posttest 

- i ^ ' 

! Sample Variance | S= 7.18 ' S= 7.09 • 

TABLE 5 
t obs. = 1.356 
f = 52.25 

TABLE 6 
t obs. = 1.719 
f = 43.68 



TABLE 7 

CONTENT KNOWLEDGE PRETEST DATA 



Group 


N 


Mean 


Std. Dev. 


1 


planetarium 


47 


8.94 


3.25 


t 


classroom 


23 


7.91 


2.15 


Junior High School 


combined 


26 


11.27 


2.49 




planetarium 


25 


13.20 


3.09 




■ classroom 


21 \ 


13.43 


3.27 


College 


combined 


25 

! 


14.00 


2.73 j 

1 


i 



TABLE 8 

MALYSIS OF VARIANCE OF CONTENT PRETESTS 

Source of variation SS df MS 

B.ween Groups 162.60 2 81.30 

Within Groups 674.35 9 3 8.33 

Total 836.95 
TABLE 9 

ANALYSIS OF VARIANCE OF CONTENT PRETESTS 

Source of variation SS df MS 

Between Groups 8.44 2 4.22 

Within Groups 649.14 68 9.546 

Total 657.58 



TABLE 10 
POSTTEST GROUP DATA 



1 

Group 


! » 


Mean 


Std. Dev. 




planetarium 


1 

43 


1 j 

9.09 


3.41 




classroom 


23 


7.61 


2.53 


Posttest 


combined 


28 


14.14 


3.11 


r 


planetarium 




9.00 


3.13 




classroom 


21 


7.67 


2.86 


Retention 


combined 


27 


13.96 


3.38 
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9.766 



0.442 



TABLE 11 



Ai>lALYSIS OF COVARIANCE SUIlI-IARY TABLE 



Source SS df liS F 

treatraent 282.70 2 141.35 17.05 

(Between) 

error 704.64 85 8.29 
(Within) 

Total 987.34 87 



treatment group treatment mean . adjusted mean 

Coinbined 14.44 13.40 

planetarium 9.09 9.32 

classroom 7.76 8.54 



TABLE 12 

ANALYSIS OF COVARIAl^^CE SUIulARY TABLE 



Source 

treatraent 
(Between) 

error 
(Within) 

Total 



SS 



304.06 



df 



777.06 77 



1081.13 79 



MS 



152.03 15.07 



10.09 



treatment group 

Combined 
planetarium 
class room 



treatment mean 

13.88 
8.95 
7.61 



adjusted mean 

13.33 
9.04 
8.18 



TABLE 13 



COLLEGE POSTTEST DATA 



Group 


N 


lie an 


1 Std. Dev. 


1 


planetarium 


19 


14.00 


I 

. 2.57 


1 


classroom 


17 


14.06 


2.92 


Posttest j 


combined 


. 


15.00 

1 


.. 2.93 


1 


1 planetarium 


20 


14.65 


3.57 




i 

; classroom 


15 


14.60 


3.38 


Retention | 


! combined 


13 


16.11 


2.49 





TABLE 14 

TWO WAY AI^IALYSIS OF VARIANCE SUMMARY TABLE 



Source 



df 



MS 



F-ratio 



A posttest- 
retention test 
intervals 

B treatments 

AB tests by 
treatments 

Error (within 
cells) 



104 



16.00 
18.22 
0.83 
9.51 



1.68 



1.92 



0.0874 



TABLE 15 

SUrtMART OF FACTOB ^mySES— IT(?E CC^fCEPTS, KJOLSD GROUPS 





Junior Higb School (pretest) 


(posttest) 


Concept 


number of 
factors 


total 55 
variance 
acct'd for 


number of 
factors 


total ^ 
variance 
acct'd for 


1 


6 


60.58 


6 


65.3c? 


2 


6 


62.53 


6 


69.20 


3 


5 


62.91 


3 


65.86 


k 


6 


67.81 


h 


59.12 


5 


l> 


66.09 


3 


60. 1(9 




College (pretest) 


■ 

(posttest) 


Conc!*pt 


number of 
factors 


total i 
variance 
acct' d for 


niaaber of 
factors 


total ^ 
variance 
acct'd for 


1 


6 


61 M 


5 


65. 7H 


2 


6 


70.73 


5 


6l;.92 


3 


6 


73.1*5 


k 


65.36 


h 


5 


69.1*0 


5 


70.93 


5 




72.57 


k 


7U.U3 



i 

o 
a 



16- 



15- 



Ik 




retention test 



postteat 



^1 *2 ^5 

(treatmentB) 



FIGUEE 2 
Simple Effects 



8 



.6.0.. 



5.0. . 




Oomblned 



Planetarium 
Classroon 



J*.o., 



Bosttest 



f 

Betentlon 




o 

ERIC 



FIGUSZ 4 




SUMMARY MD IMPLICATIONS 

The conclusions to the Student's t distribution with tne Welch approxi- 
mation is that the group which experienced the orientation session did signifi- 
cantly better than the group which did not. An omega squared statistic indicated 
that there was a strong association in this difference. This finding is in 
agreement with what planetarium operators have eluded to. The study does 
not attempt to isolate the particular cause for the effect, but rather attempts 
to determine if the effect exists and whether it can be minimized. 

The implication to be drawn from this segment of the study is that if a 
planetarium experience is contemplated the teacher needs to provide for an 
orientation session or schedule a nuraber of sessions in the planetarium before 
instructional objectives can successfully be taught. This is in direct contrast 
to current planetarium useage. 

Using the pretest data as a covariate, the combined treatment group was 
the only group which significantly benefitted from the treatment. The planetarium 
group showed a slight increase in achievement and the classroom group showed a 
decrease in content achievement. The decrease in achievement of the classroom 
group may be attributed to an experimentally induced difference. Similar 
analysis of the retention test, administered six weeks after the completion of 
the unit, indicated a minimal loss of all groups in content achievement as well 
as the maintenance of the sigtiif icantly greater combined treatment group 
criterion score. 

These findings suggest that at the junior high school level a combined 
teaching approach utilizing student centered activities in conjunction with 
planetarium experiences is more effective than the exclusive use of either 
teaching procedure. 
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Analysis of the overall pusttest scores indicates that there was no 
interaction effect between treatment and retention for the college treatment 
groups. No treatment was more effective in the immediate attainment or 
retention of content oDjectives, All treatment groups achieved equally well. 

The semantic differential concepts used x<7ere grouped into two broad cate- 
gories; those related to their future participation in astronomy and those re- 
lated to parts of the instructional unit. Scores on this instrument were 
factor analyzed and factor loadings obtained using the varimax rotation proce- 
dure. The overall perception change for all concepts showed that the 
planetarium group in both the junior high school and college studies had the 
greatest positive perception. The combined group in both cases had a negative 
standard score change. The junior high school classroom group had a slight 
positive standard score change while the college group had a negative standard 
score change. 

It can be concluded from this study that the effectiveness of the plane- 
tarium appears not to lie in facilitating content achievement, but rather in 
effecting attitudinal change. Student experiences in the planetarium should 
take into account the ability of the facility to positively change student 
perceptions or attitudes. Tnese findings further suggest tnat it would be of 
greater benefit to develop planetarium experiences that deal primarily in 
the affective domain. 



